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Description 

BACKGROUND OF THE INVENTION 

1. Technical Field: 

[0001] The present invention relates in general to 
an improved data processing system, and in particular 
to a method and system for associating data sets with a 
multimedia presentation operating within a data 
processing system. Still more particularly, the present 
invention relates to a method and system for associat- 
ing stored data sets with an animated element depicted 
in a multimedia presentation and for notifying a user of 
the existence of an associated data set during a rele- 
vant portion of the multimedia presentation. 

2. Description of the Related Art: 

[0002] Computer systems are capable of communi- 
cating information with humans in many formats, includ- 
ing: text, graphics, sounds (including high-fidelity 
stereo), animated graphics, synthesized speech, and 
video. A multimedia presentation utilizes a data 
processing system to combine such information formats 
into often coherent and comprehensive presentation. 
[0003] In known data processing systems, an addi- 
tional data set may be linked to textual information. For 
example, utilizing hypertext, the existence of an addi- 
tional data set associated with a selected portion of text 
may be indicated in several ways, such as highlighting 
or underlining the selected text. The information associ- 
ated with such selected text may also be accessed in 
several ways, for example, by utilizing a pointing device, 
such as a mouse, and clicking the mouse while the indi- 
cator is positioned on the highlighted text. After select- 
ing highlighted text, the user may be presented with a 
list of additional relevant textual data sets. After choos- 
ing from such a list, additional textual information may 
be displayed in a new window. 
[0004] For example, if the word elephant appears in 
an encyclopedic article about India (note text is under- 
lined or diffa-entiated in some manner from the sur- 
rounding text), a user may elect to access an article 
about elephants by positioning a graphical indicator, 
such as a mouse pointer, over the word, and clicking the 
mouse button. This selection process may then open 
another window within the display containing textual 
information about elephants. 

[0005] In prior art systems, textual information hav- 
ing such a link to other data sets is static in nature. That 
is. the link with a particular passage of text always 
exists. While hypertext works well for textual informa- 
tion, in a multimedia environment it would be beneficial 
to link a multimedia presentation to another relevant 
data set and to allow such a link to be accessed only 
during a relevant period of time. That is. the link with an 
associated data set may only be active during a relevant 



portion of tiie multimedia presentation. 
[0006] In view of the above, it should be appreci- 
ated that a need exists for a method and system for 
graphically indicating, during a relevant period of a mul- 

5 timedla presentation, the existence of a data set, stored 
in a data processing system, which is associated with 
an animated element within a multimedia presentation, 
wherein a system user may elect to view or listen to the 
associated data set by selecting one or more of the 

10 available data sets. 

[0007] The article entitled (Overactive Multimedia 
Meets the Real World)) by T McMillan, Computer 
Graphics World. Vol. 12. n* 8. August 1989. pp. 39-46 
describes applications of the interactive multimedia 

IS concept, which allows a user to explore a multimedia 
database In a non-linear fashion, according to his or her 
own interests and needs. The article does not address 
the problem of attaching a data set to a selected ani- 
mated element in a multimedia presentation. 

20 [0008] The article entitled ( ©Vl - A Digital Multime- 
dia Technology)) by G. D. Ripley, Communications of 
the Association for Computer Machinery, Vol. 32, n*» 7. 
July 1989, pp. 811-822 describes tfie Digital Video 
Interactive technology which makes it possible for a 

25 user to create multimedia presentations. There is again 
no reference to the problem of attaching data sets to 
selected animated elements in an existing multimedia 
presentation. 

[0009] The article entitied <<New-Media Document 
30 (NewDoc) and Dynamic Navigation on the BTRON 
Specification)) by K. Kajimoto et al.. Proceedings of 
34th IEEE Computer Society International Conference. 
CompCon '89, 27 Feb. - 3 March 1989, pp. 40-42 
describes a system for allowing a user to retrieve data 
35 from stored data sets during relevant time sequences 
as a video-data presentation is played. While tiiis article 
refers to a dynamic, as opposed to static, use of links, it 
does not suggest to attach stored data sets to selected 
animated elements. 

40 

SUiWIWARY OF THE INVENTION 

[0010] It is therefore one object of the present 
invention as delined in tiie appended claims to provide 
45 an improved data processing system for multimedia 
presentations. 

[001 1 ] It is anotiier object of the present invention to 
provide a method and system for associating data sets 
with a multimedia presentation operating within a data 

50 processing system. 

[0012] It is yet another object of the present inven- 
tion to provide a method and system for assodating 
stored data sets with an animated element depicted in a 
multimedia presentation and notifying a user of the- 

55 existence of an associated data set during a relevant 
portion of the multimedia presentation. 
[0013] The foregoing objects are achieved as is 
now described. A method amj system are disclosed in a 
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data processing system for selectively associating 
stored data with an animated element within a multime- 
dia presentation in a data processing system. At least 
one data set is created or identified within the data 
processing system. The data set is then associated 5 
witiiln the data processing system with a selected ani- 
mated element within the multimedia presentation. 
Thereafter, during the multimedia presentation, tiie 
existence of tiie data set and the association between 
the data set and the selected animated element is w 
graphically indicated utilizing a rectangle surrounding 
the animated element, a blinking figure near the ani- 
mated element or any other suitable graphic indicator. A 
user may elect to have the associated data set pre- 
sented by selecting tiie additional graphic element 15 
associated with the specified animated element, or by 
selecting a button or ottier graphic indicator, during a 
specified period of time following the graphic indication. 
[0014] The above as well as additional objects, fea- 
tures, and advantages of the present invention will 20 
become apparent in the following detailed written 
description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 

[001 5] The novel features believed characteristic of 
the invention are set forth in the appended claims. The 
invention itself however, as well as a preferred mode of 
use, further objects and advantages thereof, will best be 
understood by reference to the following detailed 30 
description of an illustrative embodiment when read in 
conjunction witii the accompanying drawings, wherein; 

Figure 1 depicts a pictorial illustration of a data 
processing system which may be utilized to imple- 35 
ment the method and system of tiie present inven- 
tion; 

Rgure 2 is a high level block diagram further illus- 
trating details of tiie data processing system as 40 
shown in Rgure 1 ; 

Rgure 3 depicts a pictorial representation of a data 
processing system display at tiiree sequential 
points in time during a multimedia presentation; 45 

Rgure 4 is a high level logical flow chart which 
depicts a programmed response of the data 
procesang system of Figure 1 in accordance witii a 
preferred embodiment of tiie method and system of so 
the present invention during a set-up operation; 

Rgure 5 is a high level logical flow chart which illus- 
trates a programmed response of the data process- 
ing system of Rgure 1 in accordance witii a 55 
preferred embodiment of ttie method and system of 
the present invention during a graphic indication 
process; and 



Rgure 6 is a high level logical flow chart which 
depicts a programmed response of tfie data 
processing system of Figure 1 in accordance with a 
prefen-ed embodiment of the method and system of 
tiie present invention during a user selection proc- 
ess. 

DETAILED DESCRIPTION OF PREFERRED EMBOD- 
IMENT 

[001 6] Witii reference now to the figures and in par- 
ticular witii reference to Figure 1 , ttiere is depicted a pic- 
torial illustration of a data processing system 50 which 
may be utilized to implement a prefen-ed embodiment of 
ttie present invention. Data processing system 50 
includes a system unit 52, a video display terminal 54, a 
keyboard 56, and a mouse 58. Data processing system 
50 may be implemented utilizing any suitable computer 
such as an IBM PSy2 computer, a product of Interna- 
tional Business Machines Corporation, located in. 
ArmonK New York TS/2" is a registered trademark of 
International Business Machines Corporation, located 
in Armonk, New York. Although ttie depicted embodi- 
ment Involves a personal computer, a preferred embod- 
iment of tiie present invention may be implementesd in 
ottier types of data processing systems, such as for 
example, intelligent workstations or mini-computers. 
[0017] Those skilled in tfie art will appreciate ttiat 
tiie hardware depicted in Figure 1 may vary for specific 
applications. For example, other peripheral devices 
such as: optical disk media, audio adapters, and the like 
also may be utilized in addition to ttie' hardware 
depicted. Data processing system 50 may include video 
storage devices (not shown) for storing digital data sets 
in either analog or digital formats. Examples of such 
video storage devices are laser disk players and video 
recording devices. Audio storage devices, such as com- 
pact disk players, also may be included in data process- 
ing system 50. 

[001 8] Figure 2 is a high level block diagram f urttier 
illustrating details of a preferred data processing system 
50 as shown in Rgure 1 . Data processing system 50 is 
controlled primarily by software executed within central 
processing unit (CPU) 202. CPU 202 is coupled to dis- 
play 204. and receives user input from user input device 
206. CPU 202 is also coupled to memory 208 and one 
or more direct access storage devices (DASDs) 
depicted at block 210. Memory 208 and DASD 210 may 
be used for storing data sets comprised of digital repre- 
sentations of text graphics, sound, animated graphics, 
synthesized speech, and video. User input device 206 
may be a mouse, a touch sereitive tablet or saeen, a 
joy stick, a frack ball, or a screen activated light pen. 
CPU 202 also coupled to audio output device 212 and 
peripheral controller 214. Audio output device 212. 
which may include an anplifier and speaker system, 
may be utilized to present an audio portion of a multime- 
dia presentation. Peripheral controller 214 may be uti- 
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lized to control peripheral devices, such as a video 
player/recorder, a slide projector or a laser disk player, 
during a multimedia presentation. 
[0019] During a multimedia presentation, CPU 202 
may access data sets comprising digital representa- 
tions of text, graphics, animated graphics, and video, 
from memory 208 or DASD 210. and utilize display 204 
to display the visual portion of a multimedia presenta- 
tion. CPU 202 may also access data sets comprising 
digitized sound or data used to produce synthesized 
speech, and utilize audio output device 212 to present 
the aural portion of a multimedia presentation. 
[0020] Those persons skilled in the art will recog- 
nize that other media, besides aural and visual media, 
may be incorporated into a multimedia presentation. For 
exanple, the medium of motion may be utilized to com- 
municate the feeling of flight to the user of a flight simu- 
lator A data set representing commands to move the 
flight simulator in a predetermined fashion may be 
accessed by CPU 202, in response to input from user 
input device 206, and tiien transmitted, via peripheral 
controller 214. to tiie mechanism which moves tiie flight 
simulator. 

[0021] Turning now to Figure 3. ttiere is depicted 
display 204 at three sequential points in time during a 
multimedia presentation. Figure 3a illustrates first run- 
ning person 302 entering the field of view on display 
204. Although depicted in stick figure format within Fig- 
ure 3, those skilled in tiie art will appreciate that each 
person depicted therein may be presented, as part of a 
video presentation. First running person 302 is an ani- 
mated element within tiie multimedia presentation. 
[0022] Rgure 3b depicts two animated elements: 
first running person 302 leaving the field of view, and 
second running person 304 entering tiie field of view. 
Graphic indicator 306. which is associated with, and fol- 
lowing tiie motion of, second running person 304. may 
be utilized to indicate the presence of an associated 
data set stored within data processing system 50 which 
is also currently relevant to tiiis portion of tiie multime- 
dia presentation. Such an associated data set may, in 
this example, contain additional information concerning 
second running p&son 304. and may be in the fomi of 
text, graphics, sounds, animated graphics, syrthesized 
speech, or video. A data processing system user may 
choose to view or listen to the associated data set if the 
user requests the additional data set be presented, 
witiiin a predetermined period of time during tfie multi- 
media presentation. The predetermined period of time 
in which a user may request to view an additional data 
set may be the period of time in which graphic indicator 
306 is displayed and assodated witti an animated ele- 
ment, such as second running person 304. 
[0023] Graphic button 310 may be utilized in con- 
junction with, or as an alternative to. graphic indicator 
306 to indicate the presence of a relevant associated 
data set. Graphic button 310 may also be utilized in con- 
junction witti, or as an altemative to, graphic Indicator 



306 as a means to indicate the active portion of display 
204 wherein a user may elect to have a relevant associ- 
ated data set presented by selecting the active portion 
of display 204 utilizing a pointing device, such as a 
5 mouse. 

[0024] Those persons skilled in tiie art will also rec- 
ognize tiiat sound may be audibly variable or aurally ani- 
mated and tiierefore, music may be considered an 
animated element within a multimedia presentation. If 

10 tiie animated element having an associated data set is 
sound, the graphic indicator utilized to indicate the pres- 
ence of an associated data set may be an appropriate 
button, such as graphic button 310, graphically dis- 
played on display 204. 

15 [0025] Rgure 3c depicts a point in the multimedia 
presentation after the point illustrated in Figure 3b, 
where second running person 304 is leaving the field of 
view and no longer has graphic indicator 306 following 
second running person 304. Also shown entering dis- 

20 play 204 is third running person 308. Graphic indicator 
306 is displayed when a data set associated with an ani- 
mated element, such as second running person 304. 
exists and when tiie associated data set is relevant to 
what is transpiring in the multimedia presentation. 

25 [0026] Referring now to Figure 4. tiiere is depicted 
a high level logical flow chart illustrating a programmed 
response of the data processing system of Figure 1 in 
accdrdance witfi a preferred embodiment of the method 
and system of tine present invention during a set-up 

30 operation. Terminal block 400 represents the entry point 
to tfie process. First, as illustrated at block 402, data 
sets, which may include a multimedia presentation and 
tfie data to be associated with an animated element 
witiiin tfie multimedia presentation, are created or iden- 

35 titled within data processing system 50. Next, as illus- 
trated at block 404, tfie data sets are stored witfiin data 
processing system 50. Block 406 illustrates tiie next 
step of associating tiie data sets witfi selected animated 
elements witiiin a multimedia presentation. In tiiis 

40 example, the multimedia presentation may be a video of 
people running in a foot race. The associated data set 
may be statistics, or an interview with, a particular run- 
ner in the race. 

[0027] Next, as depicted at block 408, a time period 
45 is selected in which a graphic indicator is displayed in 
association witti selected animated elements to indicate 
ttie presence of an associated data set stored witfiin 
data processing system 50. Typically, the graphic indi- 
cator is displayed when tfie associated data set is rele- 
50 vant to tiie activity of the animated element at ttiat 
particular time in the multimedia presentation. The 
graphic indicator may, for example, be a rectangle sur- 
rounding and followving the animated element, as shown 
in Figure 3b by graphic indicator 306. or tiie graphic indi- 
55 cator may inciiKle a graphic button placed in display 
204. The graphic indicator may also be a blinking ele- 
ment User selection of an additional data set may be 
accomplished by utilizing a graphic button in assodation 
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with a graphic indicator, such as graphic indicator 306. 
[0028] In addition to selecting a time to display a 
graphic indicator, as depicted at block 408. a period of 
time may be selected in which a user s attempt to select 
an associated data set is effective, as depicted at block 
410. TTie period of time during the multimedia presenta- 
tion In which the associated graphic indicator is dis- 
played with an animated element is not necessarily the 
same period of time in which a user may select to view 
or listen to the associated data set. Finally, terminal 
block 412 represents the end of the set up process. 
[0029] With reference now to Figure 5, there is 
depicted a high level logical flow chart which illustrates 
a programmed response of the data processing system 
of Figure 1 in accordance with a preferred embodiment 
f the method and system of the present Invention during 
a graphic indication process. Terminal block 500 repre- 
sents the entry point to the process. First, as depicted at 
block 502, a multimedia presentation is started. A multi- 
media presentation may communicate data sets stored 
within data processing system 50 in several formats, 
including: text, graphics, sound (including hi-fidelity 
stereo), animated graphics, synthesized speech, and 
video. As the multimedia presentation continues, the 
process continuously determines whether or not an ele- 
ment having an associated data set is present within 
display 204. as illustrated at decision block 504. If ani- 
mated elements having associated data sets are not 
present, the process determines whether or not the 
multimedia presentation has been completed, as 
depicted at decision block 506. If the multimedia pres- 
entation has been completed, the process ends, as 
illustrated terminal block 508. If the multimedia presen- 
tation has not been completed, the process continues 
presenting the multimedia presentation, as depicted at 
process block 510. 

[0030] Refen-ing again to block 504. and after deter- 
mining that an animated element having an associated 
data set is present within the display, the process next 
determines whether or not the data set associated with 
the animated element is relevant at this particular point 
in the multimedia presentation, as illustrated at decision 
block 512. Selected animated elements will always be 
associated with particular data sets, but such data sets 
may not always be relevant to the present activity por- 
trayed in the multimedia presentation. If the associated 
data set is not reia/ant at this point in the multimedia 
presentation, the process continues to look for ani- 
mated elements within the display having associated 
data sets, as illustrated at decision block 504. 
[0031 ] H the element having an associated data set 
is present within display 204 and the associated data 
set is currently relevant, the process illustrates graphi- 
cally that the animated element has a relevant associ- 
ated data set. as depicted at block 514. As discussed 
previously, the graphic indication may be a rectangle 
sun-ounding. and moving with, the selected animated 
element, as shown in Figure 3b by graphic indicator 



306. Next, the process permits the user to effectively 
select additional data sets associated with the selected 
animated element, as illustrated at process block 516. 
The process then determines whether or not the period 

5 for graphically indicating the existence of an associated 
data set has expired, as depicted at decision block 518. 
If such an indication period has not expired, then effec- 
tive user selection is permitted as illustrated at block 
516. If such an indication period has expired, then the 

10 process removes the graphic indication associated with 
the selected animated element, as illustrated at block 
520. The effective user selection period may or may not 
coincide with the period of time the graphic indication is 
associated with the selected animated element. There- 

15 fore, the process must separately determine whether or 
not the user selection period has expired, as depicted at 
decision block 522. If the user selection has not expired, 
effective user selection is permitted, as illustrated at 
block 524. 

20 [0032] If the user selection period has expired, then 
the process makes further attempts by the user to select 
the associated data set ineffective, as depicted at block 
526. After user selection has been made ineffective, as 
illustrated at block 526, the process determines whether 

25 or not the multimedia presentation has been completed, 
as depicted at decision block 506. If the multimiBdia 
presentation has not been completed, the process con- 
tinues presenting the multimedia presentation, as illus- 
trated at block 510, and the above process is repeated. 

30 If the multimedia presentation has been conpleted, the 
process ends, as illustrated at terminal block 508. 
[0033] Rnally. with reference to Figure 6. there is 
depicted a programmed response of the data process- 
ing system 50 wherein the user selection of associated 

35 data sets is explained in further detail. Terminal t)lock 
600 illustrates the starting point for the process. The 
process first determines whether or not a user has 
made an effective selection, as depicted at decision 
block 602. An effective user selection can only be made 

40 during a selected period of time as determined at proc- 
ess block 410 of Figure 4. If the user attempts to make 
a selection during any other period of time, the selection 
Is considered Ineffective and the process will continue 
waiting for an effective selection, as shown at decision 

45 block 602. 

[0034] If an effective user selection has been made, 
ttie multimedia presentation is paused, as illustrated at 
block 604. Then, a list of associated data sets is dis- 
played so the user may make a selection, as depicted at 

50 block 606. After displaying such a list, the process waits 
for the user to select an associated data set as illus- 
trated at decision blocks 608 and 610. If the user 
decides to cancel tiie selection of an associated data 
set. the process then determines whether tfie multime- 

55 dia presentation has been conrpleted. as depicted at 
decision block 612. If the user has selected an associ- 
ated data set then the process presents tfie associated 
data set. as illustrated at block 614. Presentation of the 
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associated data set may be accomplished by opening a 
separate window on display 204 and presenting the 
associated data set which may comprise a variety of 
multimedia formats. After the associated data set is pre- 
sented, the process determines whether or not the mul- 5 
timedia presentation has been completed, as depicted 
at decision block 61 2. If the multimedia presentation has 
been completed, the process ends as illustrated at ter- 
minal block 614. If the multimedia presentation has not 
been completed, the multimedia presentation contin- yo 
ues, as depicted at block 61 6, and the process waits for 
the next effective user selection, as illustrated at deci- 
sion block 602. If the user makes another effective 
selection, the process described above repeats. 

IS 

Claims 

1. A method for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation stored in a data processing system. 20 
said data comprising at least one data set being 
stored within said data processing system, said 
method comprising the steps of : 

associating said at least one data set within 25 
said processing system with a selected ani- 
mated element within said multimedia presen- 
tation; 

providing a graphical indicator within said mul- 30 
timedia presentation indicative of the existence 
of said at least one data set and said associa- 
tion between said at least one data set and said 
selected animated element, whereby a user of 
said data processing system is informed of the 35 
existence of said at least one data set; 

permitting said user to select at least one data 
set for presentation; 

40 

retrieving and presenting said at least one data 
set in response to an input from said user indic- 
ative of the selection of said at least one data 
set; and 

45 

temporarily suspending said multimedia pres- 
entation in response to said retrieval and pres- 
entation of said at least one data set. 

2. A method for selectively assodating stored data so 
with animated elements depicted in a multimedia 
presentation according to claim 1 wherein said step 

of retrieving and presenting said at least one data 
set in response to an input from a user is permitted 
only during a selected period of time. 55 

3. A method for selectively associating stored data 
with animated elements depicted in a multimedia 



presentation according to daim 1 wherein said step 
of providing a graphical indicator within said multi- 
media presentation indicative of the existence of 
said at least one data set and sakJ association 
between said at least one data set and said 
selected animated element comprises the step of 
temporarily displaying an additional graphical ele- 
ment in association witfi said selected animated 
element. 

4. A metiiod for selectively associating stored data 
witii an animated elements depicted in a multime- 
dia presentation according to claim 2 wherein said 
step of providing a graphical indicator within said 
nruiltimedia presentation indicative of the existerKe 
of said at least one data set and said association 
between said at least one data set and said 
selected animated element comprises displaying 
an additional graphical element in association witii 
said selected animated element only during said 
selected period of time. 

5. A metiiod for selectively associating stored data 
witii animated elements depicted in a multimedia 
presentation according to daim 3 wherein said step 
of temporarily displaying an additional graphical 
element in association with said selected animated 
element comprises tiie step of displaying a rectan- 
gle which substantially surrounds said selected ani- 
mated element. 

6. A metiiod for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation according to daim 1 wherein said step 
of assodating said at least one data set witiiin said 
data processing system witti said selected ani- 
mated element indudes the step of associating a 
plurality of data sets within said data processing 
system witii said selected animated element, and 
furtiier including tiie step of retrieving and present- 
ing a user witii a choice of said plurality of associ- 
ated data sets in response to an input from a user. 

7. A system for selectively associating stored data 
vntii animated elements depicted in a multimedia 
presentation stored in a data processing system, 
said data comprising at least one data set being 
stored within said data processing system, conv 
prising: 

means for assodating said at least one data 
set within said processing system with a 
selected animated element vnthin said multi- 
media presentation; 

means for providing a graphical indicator witiiin 
said multimedia presentation indicative of tiie 
existence of said at least one data set and said 
assodation between said at least one data set 
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and said selected animated element, whereby 
a user of said data processing system may be 
informed of the existence of said at least one 
data set; 

means for permitting said user to select said at 5 
least one data set for presentation; 
means for retrieving and presenting said at 
least one data set in response to an input from 
said user indicative of the selection of said at 
least one data set; and io 
means for temporarily suspending said multi- 
media presentation in response to said 
retrieval and presentation of said at least one 
data set. 

15 

8. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation witiiin a data processing system 
according to daim 7 wherein said means for retriev- 
ing and presenting said at least one data set in so 
response to an input from a user permits retrieving 
and presenting said at least one data set in 
response to an input from a user only during a 
selected period of time. 

25 

9. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation within a data processing system 
according to claim 7 wherein said means for provid- 
ing a graphical indicator within said multimedia 30 
presentation indicative of tiie existence of said at 
least one data set and said association between 
said at least one data set and said selected ani- 
mated element conrprises means for temporarily 
displaying an additional graphical element in asso- 35 
ciation with said selected animated element. 

10. The system for selectively associating stored data 
with animated elements depicted in a multimedia 
presentation witinin a data processing system 4o 
according to claim 8 wherein said means for provid- 
ing a graphical indicator within said multimedia 
presentation indicative of tiie existence of said at 
least one data set and said assodation between 
said at least one data set and said selected ani- 45 
mated element conprises means for displaying an 
additional graphical element in association with 
said selected animated element only during said 
selected period of time. 

50 

11. The system for selectively assodating stored data 
with animated elements depicted in a multimedia 
presentation within a data processing system 
according to daim 9 wherein said means for tenpo- 
rarily displaying an additional graphical element in 55 
association with said selected animated element 
comprises means for displaying a rectangle which 
substantially surrounds said selected animated ele- 



ment. 

12. The system for selectively assodating stored data 
with animated elements depicted in a multimedia 
presentation witiiin a data processing system 
according to claim 7 wherein said means for asso- 
dating said at least one data set within said data 
processing system witfi a selected animated ele- 
ment includes means for associating a plurality of 
data sets within said data processing system with a 
selected animated element, and further including 
means for retrieving and presenting a user with a 
choice of said plurality of associated data sets in 
response to an input from a user. 

PatentansprOche 

1. Ein Vertahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen, abgebildet 
in einer Multimedia-Darstellung, die in einem 
Datenverarbeitungssystem gespeichert ist, wobei 
diese Daten mindestens einen Datensatz enthal- 
ten, der in dem Verarbeitungssystem gespeichert 
wird, und dieses Verfahren die folgenden Schritte 
umfaBt: 

Zuordnen dieses mindestens einen Datensat- 
zes innerhalb des Verarbeltungssystems zu 
einem ausgewahlten animierten Element 
innerhalb der Multimedia-Darstellung; 

Vorsehen eines graphischen Indikators inner- 
halb der Multimedia-Darstellung, der auf das 
Vorkommen dieses mindestens einen Daten- 
satzes und die Zuordnung zwischen dem min- 
destens einen Datensatz und dem gewahlten 
animierten Element hinweist. wodurch ein 
Anwender des Datenverarbeitungssystems 
Qber das Vorkommen dieses mindestens einen 
Datensatzes untemchtet wird; 

Zulassen, daB dieser Anwender diesen minde- 
stens einen Datensatz zur Darstellung aus- 
wdhlt; 

Abrufen und Abbilden dieses mindestens einen 
Datensatzes als Reaktion auf eine Eingabe 
seitens des Anwenders, die auf die V\fahl die- 
ses mindestens einen Datensatzes hinweist; 
und 

zeitweilig Unterbrechen dieser Multimedia-Dar- 
stellung als Reaktion auf das Abrufen und 
Abbilden dieses mindestens einen Datensat- 
zes. 

2. Ein Verlahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen. die in 
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einer Multimedia-Darstellung gemaB Anspruch 1 
abgebildet sind, wobei der Schritt des Abrufens und 
des Abbildens dieses mindestens einen Datensat- 
zes als Reaklion auf eine Eingabe seitens eines 
Anwenders nur wahrend einer ausgewShlten Zeit- 5 
spanne zuiassig 1st. 

3. Ein Verfahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen, die in 
einer Muttimedia-Darstellung gemSB Anspruch 1 10 
abgebildet werden. wobei der Schritt des Vorse- 
hens eines graphischen Indikators in der Multime- 
dia-Darstellung, der auf das Vorkommen dieses 
mindestens einen Datensatzes und die Zuordnung 
zwischen dem mindestens einen Datensatz und 75 
dem gewahlten animierten Element hinweist. den 
Schritt des zeitweiligen Anzeigens eines zusatzli- 
chen graphischen Elements in Zuordnung zu dem 
gewahlten animierten Element beinhaltet. 

20 

4. Ein Verfahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen. die in 
einer Multimedia-Darstellung gemaB Anspruch 2 
abgebildet werden. wobei der Schritt des Vorse- 
hens eines graphischen Indikators in der Multime- 25 
dia-Darstellung, der auf das Vorkommen dieses 
mindestens einen Datensatzes und die Zuordnung 
dieses mindestens einen Datensatzes zu dem 
gewahlten animierten Element hinweist die 
Anzeige eines zusatzllchen graphischen Elements 30 
in Zuordnung zu dem gewahlten animierten Ele- 
ment nur wahrend der gewahlten Zeitspanne 
beinhaltet. 

5. Ein Verfahren zum selektiven Zuordnen gespei- 35 
cherter Daten zu animierten Elementen. die in 
einer Multimedia-Darstellung gemaB Anspruch 3 
abgebildet werden, worin der Schritt des zeitweili- 
gen Anzeigens eines zusatzlichen graphischen 
Elements in Zuordnung zu dem gewahlten animier- 40 
ten Elements den Schritt der Anzeige eines Recht- 
ecks beinhaltet. das im wesentlichen das gewahlte 
animierte Element umgibt. 

6. Ein Verfahren zum selektiven Zuordnen gespei- 45 
cherter Daten zu animierten Elementen. die in 
einer Multimedia-Darstellung gemaB Anspruch 1 
abgebildet werden, worin der Schritt des Zuord- 
nens dieses mindestens einen Datensatzes inner- 
haib des Datenverarbeitungssystems zu dem so 
gewahlten animierten Element den Schritt des 
Zuordnens einer Vielzahl von Datensatzen inner- 
halb des Datenverarbeitungssystems zu dem ani- 
mierten Element, und wetter den Schritt des 
Abrufens und Stellens des Anwenders vor die Wahl 55 
eines aus der Vielzahl der zugeordneten Daten- 
satze als Reaktlon auf eine Eingabe sertens eines 
Anwenders beinhaltet 



7. Ein System zum selektiven Zuordnen gespeicher- 
ter Daten zu animierten Elementen. abgebildet In 
einer Multimedia-Darstellung, die In einem Daten- 
verarbeitungssystem gespeichert ist. wobei diese 
Daten mindestens einen Datensatz enthalten. der 
in dem Verarbeitungssystem gespeichert wind, ent- 
haltend: 

Mittel zum Zuordnen dieses mindestens einen 
Datensatzes innerhalb des Verarbertungssy- 
stems zu einem ausgewahlten animierten Ele- 
ment innerhalb der Multimedia-Darstellung; 

Mittel zum Vorsehen eines graphischen Indika- 
tors innerhalb der Multimedia-Darstellung. der 
auf das Vorkommen dieses mindestens einen 
Datensatzes und die Zuordnung zwischen dem 
mindestens einen Datensatz und dem gewahl- 
ten animierten Element hinweist, wodurch ein 
Anwender des Datenverarbeitungssystems 
uber das Vorkommen dieses mindestens einen 
Datensatzes unterrichtet werden kann; 

Mittel zum Zulassen. daB dieser Anwender die- 
sen mindestens einen Datensatz zur Darstel- 
lung auswahit: 

Mittel zum Abrufen und AbbiWen dieses minde- 
stens einen Datensatzes als Reaktion auf eine 
Eingabe seitens des Anwenders. die auf die 
Wahl dieses mindestens einen Datensatzes 
hinweist; und 

Mittel zum zeitweilig^ Unterbrechen dieser 
Multimedia-Darstellung als Reaktion auf das 
Abrufen und Abbilden dieses mindestens einen 
Datensatzes. 

8. Das System zum selektiven Zuordnen gespeicher- 
ter Daten zu animiertei Elementen, die in einer 
Multimedia-Darstellung innerhalb eines Datenver- 
arbeitungssystems gemaB Anspruch 7 abgebildet 
sind, wobei das Mittel zum Abrufen und Abbilden 
dieses mindestens einen Datensatzes als Reaktion 
auf eine Eingabe seitens eines Anwenders das 
Abrufen und Abbilden dieses mindestens einen 
Datensatzes ais Reaktion auf eine Eingat>e eines 
Anwenders nur wahrend einer ausgewahlten Zeit- 
spanne zuiaBt 

9. Das System zum selektiven Zuordnen gespeicher- 
ter Daten zu animierten Elementen, die in einer 
Multimedia-Darstellung gemaB Anspruch 7 abge- 
bildet werden, worin das Mittel zum Vorsehen eines 
graphischen Indikators in der Multimedia-Darstel- 
lung auf das Vorkommen dieses mindestens eines 
Datensatzes und die Zuordnung zwischen dem 
mindestens einen Datensatz und dem gewahlten 
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animierten Element hinweist, Mrttel zum zeitweili- 
gen Anzeigen eines zusatzlichen graphischen Ele- 
ments in Zuordnung zu dem gewahlten animierten 
Element belnhaltet. 

5 

10. Das System zum selektiven Zuordnen gespeicher- 
ter Daten zu animierten Elementen, die in einer 
Multimedia-Darstellung in einem Datenverartei- 
tungssystem gemaB Anspruch 8 abgebildet wer- 
den, worin die Mittel zum Vorsehen eines io 
graphischen Indikators in der Multimedia-Darstel- 
lung, der auf das Vorkommen dieses mindestens 
einen Datensatzes und die Zuordnung dieses min- 
destens einen Datensatzes zu dem gewahlten ani- 
mierte Element hinweist, Mittel zur Anzeige eines is 
zusatzlichen graphischen Elements in Zuordnung 

zu dem gewahlten animierten Element nur wahrend 
der gewahlten Zeitspanne umfaK. 

11. Das System zum selektiven Zuordnen gespeicher- so 
ter Daten zu animierten Elementen, die in einer 
Multimedia-Darstellung innerhalb eines Datenver- 
arbeitungssystems gemai3 Anspruch 9 abgebildet 
werden, worin das Mittel zur zeitweiligen Anzeige 
eines zusatzlichen graphischen Elements In Zuord- 25 
nung zu dem gewahlten animierten Element Mittel 

zur Anzeige eines Rechtecks beinhaltet, das im 
wesentlichen das gewahlte animierte Element 
umgibt. 

30 

12. Ein Verfahren zum selektiven Zuordnen gespei- 
cherter Daten zu animierten Elementen. die in 
einer Multimedia-Darstellung innerhalb eines 
Datenverarbeitungssystems gemaiB Anspruch 7 
abgebildet werden. worin der Schritt des Zuord- 35 
nens dieses mindestens einen Datensatzes inner- 
halb des Datenverarbeitungssystems zu einem 
gewahlten animierten Element Mittel zum Zuord- 
nen einer Vielzahl von Datensatzen innertialb des 
Datenverarbeitungssystems zu dem animierten 4o 
Element, und welter Mittel zum Abrufen und Stellen 
des Anwenders vor die Wahl eines aus der Vielzahl 
der zugeordneten Datensatze als Reaklion auf eine 
Eingabe seitens eines Anwenders beinhaltet 

45 

Revendications 

1 . Proc6d6 pour associer s6Iectivement des donn6es 
m6moris6es avec des 6l6ments animus repr§sen- 
t6s dans une pr6sentation multim6dia m6moris6e so 
dans un systems de traitement de donn6es, lesdi- 
tes donn6es comprenant au moins un jeu de don- 
n6es m6moris6 a rint6rieur dudit syst6me de 
traitement de donn6es, ledit proc6d6 conrprenant 
les 6tapes consistant a : 55 

associer ledit au moins un jeu de donn6es a 
rint6rieur dudit syst^me de trartOTOTt avec un 



6l6ment anim6 s6Iectionn6 a rint6rieur de 
ladite pr6sentation multimedia ; 

procurer un indicateur graphique a rint6rieur 
de ladite pr^entation muttim^ia indicatif de 
I'existence dudit au moins un jeu de donn^es et 
ladite association entre ledit au moins un jeu de 
donn^es et ledit element anim^ s6Iectionn4. 
grace a quoi un utilisateur dudit syst^me de 
traitement de donn6es est informa de I'exis- 
tence dudit au moins un jeu de donn^es ; 

permettre audit utilisateur de s^lectionner ledit 
au moins un jeu de donnaes pour pr^entation 



rataWir et presenter ledit au moins un jeu de 
donnaes en r^ponse a une entr6e en prove- 
nance dudit utilisateur, indicatif de la selection 
dudit au moins un jeu de donn6es ; et 

suspendre temporairement ladite prasentation 
multimadia en r6ponse auxdits ratablissement 
et pr6sentation dudit au moins un jeu de don- 
naes. 

2. Proc6da pour associer s6lectivement les donnaes 
m6morisaes avec des ailments anim6s reprasen- 
tas dans une presentation multimedia selon la 
revendication 1. dans lequel ladite atape de rata- 
blissement et de presentation dudit au moins un jeu 
de donnees en reponse a une entree en prove- 
nance d'un utilisateur est permise seulement pen- 
dant une periode de temps seiectionnee. 

3. Precede pour associer seiectivement des donnees 
m6morisees avec des elements animes represen- 
tes dans une presentation multimedia conforme- 
ment a la revendication 1. dans lequel ladite etape 
de fourniture d'un indicateur graphique a I'interieur 
de ladite presentation multimedia indicatif de I'exis- 
tence dudit au moins un jeu de donnees et ladite 
association entre ledit au moins un jeu de donnees 
et ledit element anime seiectionne comprend 
retape consistant a afficher temporairement un ele- 
ment graphique additionnel en association avec 
ledit element anime seiectionne. 

4. Precede pour associer seiectivement des donnees 
memorisees avec des elements animes represen- 
tes dans une presentation multimedia selon la 
revendication 2, dans lequel ladite etape de fourni- 
ture de I'indicateur graphique a llnterieur de ladite 
presentation multimedia indicatif de I'existence 
dudit au moins un jeu de donn6es et ladite associa- 
tion entre ledit au moins un jaj de donnees et ledit 
element anime seiectionne conprend I'affichage 
rfun element graphique additionnel en association 
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avec ledit 6l6ment anirn^ s6lectionn6 seulement 
pendant ladite p^riode de temps s^ectionn6e. 

5. Proc6d6 pour associer s6lectivement des donn6es 
m6nnoris6es avec des 6l6ments anim6s repr6sen- s 
t§s dans une pr^entation multimklia selon la 
revendication 3, dans lequel ladite ^tape d'affi- 
chage tenporaire d'un 6l6ment graphique addition- 
nel en association avec ledit 6l6ment anim6 
s6lectionn6 comprend r6tape d'aff ichage d'un rec- io 
tangle qui entoure essentiellement ledit 6l6ment 
anim6 s^lectionn^. 

6. Proc6d6 pour associer s6lectlvement des donn6es 
m6nrx)ris§es avec des 6l6ments anim§s repr6sen- is 
t6s dans une presentation multimedia selon la 
revendication 1 , dans lequel ladite 6tape d'associa- 
tion dudit au moins un jeu de donn6es k rint6rieur 
dudit systeme de traltement de donn6es avec ledit 
6l6ment anlm6 seiectionn6 comprend retape 20 
d'association d'une plurality de jeux de donn^es k 
rint6rieur dudit syst^me de traitement de donn6es 
avec ledit 6l6ment anim6 s6lectionn6, et conpre- 
nant en outre r6tape de r6tablissement et de pre- 
sentation k un utilisateur avec un choix de ladite 25 
plurality de jeux de donn^es associes en reponse k 
une entree en provenance d'un utilisateur. 

7. Sysieme pour associer seiectivement des donnees 
memorisees avec des elements anim6s repr6sen- 30 
tes dans une presentation multimedia m6mbris6e 
dans un systeme de traitement de donn6es. lesdi- 

tes donnees conprenant au moins un jeu de don- 
nees qui est memorise k I'interieur dudit systeme 
de traitement de donnees, comprenant : 35 

un moyen pour associer ledit au moins un jeu 
de donnees k I'interieur dudit systeme de trai- 
tement avec un element anime seiectionne k 
I'interieur de ladite presentation multimedia ; 40 

un moyen pour fournir un indicateur graphique 
k llnterieur de ladite presentation multimedia 
indicatif de I'existence dudit au moins un jeu de 
donnees et ladite association entre ledit au 45 
moins un jeu de donnees et ledit element 
anime seiectionne. d'ou il resulte qu'un utilisa- 
teur dudit systeme de traitement de donnees 
peut etre informe de I'existence dudit au moins 
un jeu de donnees ; 50 

un nrrayen pour permetti-e audit utilisateur de 
seiectionner ledit au moins un jeu de donnees 
pour presentation ; 

55 

un moyen pour retablir et presenter ledit au 
moins un jeu de donnees en r6ponse k Tentree 
en provenance dudit utilisateur, indicative de la 



selection dudit au moins un jeu de donnees ; et 

un moyen pour suspendre temporairement 
ladite presentation multimedia en reponse 
auxdits retablissement et presentation dudit au 
moins un jeu de donnees. 

8. Systeme pour associer seiectivement des donnees 
memorisees avec des elements animes represen- 
tes dans une presentation multimedia k I'interieur 
d'un systeme de traitement de donnees selon la 
revendication 7. dans lequel ledit moyen pour reta- 
blir et presenter ledit au moins un jeu de donnees 
en reponse k une enfree provenant d'un utilisateur 
permet le retablissement et la presentation dudit au 
moins un jeu de donnees en reponse k une entree 
provenant d'un utilisateur seulement pendant une 
periode de temps seiectionnee. 

9. Systeme pour associer seiectivement des donnees 
memorisees avec les elements animes representes 
dans une presentation multimedia k I'interieur d'un 
systeme de ti-aitement de donnees selon la revendi- 
cation 7, dans lequel ledit moyen pour fournir un 
indicateur graphique k I'interieur de ladite presenta- 
tion multimedia indicatif de I'existence dudit au 
moins un jeu de donnees et ladite association entre 
ledit au moins un jeu de donnees et ledit element 
anime seiectionne conrprend un moyen pour affi- 
cher tenporairement un element graphique addi- 
tonnel en association avec ledit element .anime 
seiectionne. 

1 0. Systeme pour associer seiectivement des donnees 
memorisees avec des elements animes represen- 
tes dans une presentation multimedia k I'interieur 
d'un systeme de traitement de donn6es selon la 
revendication 8. dans lequel ledit moyen pour pro- 
curer un indicateur graphique k Unterieur de ladite 
presentation multimedia indicatif de I'existence 
dudit au moins un jeu de donnees et ladite associa- 
tion entre ledit au moins un jeu de donnees et ledit 
element anime seiectionne comprend le moyen 
pour afficher un element graphique additionnel en 
association avec ledit element anime seiectionne 
pendant ladite periode de temps seiectionnee. 

11. Systeme pour associer seiectivement des donnees 
m6moris6es avec des elements animes represen- 
tes dans une presentation multimedia k llnterieur 
d'un systeme de traitement de donnees selon la 
revendication 9, dans lequel ledit moyen pour affi- 
cher temporairement un eiemoit graphique addi- 
tionnel en association avec ledit element anime 
seiectionne conprend un moyen pour afficher le 
rectangle qui entoure essentiellement ledit element 
anime seiectionne. 
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12. Syst6me pour associer s6lectivement des donn6es 
m6moris6es avec des 6l6ments anim6s repr6sen- 
t6s dans une presentation multimedia k rint6rieur 
d'un systems de traitement de donn^es selon la 
revendication 7. dans lequel ledit moyen pour asso- 5 
cier ledit au moins un jeu de donn^es k I'lnterieur 
dudit systeme de traitement de donn6es avec un 
element anime seiectionne comprend un moyen 
pour associer une pluralite de jeux de donnees k 
I'interieur dudit systeme de traitement de donnees w 
avec un element anime seiectionne. et qui com- 
prend en outre un moyen pour retablir et presenter 
k Tutilisateur un choix de ladite pluralite de jeux de 
donnees associes en reponse k une entree en pro- 
venance de I'utilisateur. 
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